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MOUSE INPUT PANEL WINDOWS CLASS LIST 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application claims priority to U.S. Provisional Patent Application Serial 
No. 60/247,831, entitled Mouse Input Panel Windows Class List, filed on November 10, 
2000, which is hereby incorporated by reference as to its entirety. The present application is 
also related to U.S. Provisional Patent Application Serial No. 60/247,182, entitled Method 
and Apparatus For Improving the Appearance of Digitally Represented Handwriting, filed on 
November 10, 2000; to U.S. Provisional Patent Application Serial No. 60/247,841, entitled 
Highlevel Active Pen Matrix, and filed on November 10, 2000; to U.S. Provisional Patent 
Application Serial No. 60/247,973, entitled Selection Handles in Editing Electronic 
Documents, and filed on November 1 0, 2000; to U.S. Provisional Patent Application Serial 
No. 60/247,842, entitled Insertion Point Bungee Space Tool, and filed on November 10, 
2000; to U.S. Patent Application Serial No. (Atty docket No. 3797.00083), entitled Selection 
Handles In Editing Documents, and filed January 24, 2001; to U.S. Provisional Patent 
Application Serial No. 60/247,844, entitled Simulating Gestures of a Mouse Using a Stylus 
and Providing Feedback Thereto, and filed on November 20, 2000; to U.S, Provisional 
Patent Application Serial No. 60/247,400, entitled System and Method For Accepting 
Disparate Types Of User Input, and filed on November 10, 2000; to U.S. Provisional Patent 
Application Serial No. 60/247,972, entitled In Air Gestures, and filed on November 10, 
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2000; to U.S. Patent Application Serial No. (Atty Docket No. 3797.00090), entitled In-Air 
Gestures For Electromagnetic Coordinate Digitizers, and filed January 15, 2001; to U.S. 
Provisional Patent Application Serial No.60/247,843, entitled Mouse Input Panel and User 
Interface, and filed on November 10, 2000; to U.S. Patent Application Serial No. (Atty 
Docket No. 3797.00092), entitled Mouse Input Panel and User Interface, and filed March 9, 
2001; to U.S. Provisional Patent Application Serial No.60/247,479, entitled System and 
Method For Inserting Implicit Page Breaks, and filed on November 1 0, 2000; to U.S. Patent 
Application Serial No. (Atty docket No. 3797.00086), entitled High Level Active Pen 
Matrix, and filed on December 15, 2000; to U.S. Patent Application Serial No. 09/741,107, 
entitled Mode Hinting/Switching, and filed on December 21, 2000, to U.S. Provisional 
Patent Application Serial No. 60/247,847, entitled Tablet Computer and its Features, and 
filed on November 10, 2000, and to U.S. Patent Application Serial No. 09/750,288, entitled 
Anchoring, Rendering, Reflow & Transformations, filed December 29, 2000, each of which 
is incorporated by reference herein as to their entireties. 

BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention relates to computing devices. More particularly, the present 
invention relates to a system and method for returning focus to a user interface window 
within a computer operating system. 
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2. Description of the Related Art 

Most personal computer (PC) systems provide a plurality of techniques for a user to 
enter data and commands, and to manipulate data. One exemplary technique is for a user to 
enter data and commands using a keyboard. Other exemplary techniques include use of a 
mouse, a track ball, and/or a voice-actuated input device. Yet another technique involves a 
using a digitizing writing pad and a stylus. 

In the situation when a conventional computer system has a display screen, and a user 
selects or clicks on a particular portion of a the display screen using, for example, a mouse, 
the proper informational context of the selected portion of the display is required by the 
operating system so that the computer responds as the user expects. For example, when the 
user clicks on a scrollbar displayed on the display of a conventional computer using the 
mouse, the underlying application responds as if a scrollbar has been clicked, instead of 
responding as if a character input was expected. 

As another example, in the situation when the user clicks an input interface with the 
stylus, such as an operating system control field or window, or a softkey keyboard display, 
the conventional computer sends the input to the last window having focus, instead of 
responding as if a scrollbar has been clicked. Moreover, for this exemplary situation, the 
focus state of the computer should be properly returned to the last window having focus. 

Focus state, or keyboard focus, as used herein, is a state that an input control interface 
acquires when a user selects the input control interface. An input control interface loses 
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focus, for example, when the user selects another input control interface. Only one input 
control interface can have keyboard focus at a time. 

Thus, what is needed is a way to determine the information context of a point that is 
displayed by a computer and that is selected by a user so that the computer responds properly. 
What is also needed is a technique for returning focus to a user input control interface when 
the user performs a predetermined action, such as entering a command and/or data into a 
computer system. 

SUMMARY OF THE INVENTION 

The present invention provides a way to determine the information context of a point 
selected by a user using a digitizing display screen/writing pad and stylus. The present 
invention also provides a method for returning focus to a user interface window so that a 
command and/or data entered by a user are directed to the proper window. Information 
relating to each user interface window existing, visible and not visible, within a computer 
operating system is stored in a working database that is different from real-time user interface 
window information maintained by the computer operating system. A top user interface 
window is determined at a display coordinate selected by, for example, a digitizing pen. 
Focus is returned to a last user interface window having focus when the top user interface 
window is a system user interface window. Additionally, an informational context is 
determined for the top window, and data entered into the top window is recognized based on 
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the informational context of the top window. The information stored in the working database 
for each user interface window existing within the computer operating system includes an 
HWND ClassName, an HWND Style and an ExStyle. Additionally, the information stored 
in the working database for each user interface window further includes at least one of 
whether the user interface window is a scrollbar; whether the user interface window is a text 
input field, whether the user interface window is a generic input field, whether the user 
interface window is a filename input field, whether the user interface window is an e-mail 
input field, whether the user interface window is a URL input field; whether an HWND is a 
button; whether the user interface window is a radio-button; whether the user interface 
window is a checkbox, and whether the user interface window is a slider. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example and not limitation in the 
accompanying figures in which like reference numerals indicate similar elements and in 
which: 

Figure 1 shows a schematic diagram of a conventional general-purpose digital 
computing environment that can be used for implementing various aspects of the invention; 

Figure 2 shows a tablet and stylus computer that can be used in accordance with 
various aspects of the present invention; 
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Figures 3a-3c respectively show an exemplary softkey keyboard, an exemplary 

character pad and an exemplary word pad; and 

Figure 4 shows a functional block diagram of the present invention. 

DETAILED DESCRIPTION 

The present invention may be more readily described with reference to Figure 1-4. 
Figure 1 illustrates a schematic diagram of a conventional general-purpose digital computing 
environment that can be used to implement various aspects of the present invention. In 
Figure 1 , a computer 1 00 includes a processing unit 1 1 0, a system memory 1 20, and a system 
bus 1 30 that couples various system components including the system memory to processing 
unit 1 10. System bus 1 30 may be any of several types of bus structures including a memory 
bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus 
architectures. System memory 120 includes read only memory (ROM) 140 and random 
access memory (RAM) 150. 

A basic input/output system 160 (BIOS), containing the basic routines that help to 
transfer information between elements within computer 1 00, such as during start-up, is stored 
in ROM 140. The computer 100 also includes a hard disk drive 170 for reading from and 
writing to a hard disk (not shown), a magnetic disk drive 1 80 for reading from or writing to a 
removable magnetic disk 190, and an optical disk drive 191 for reading from or writing to a 
removable optical disk 1 92 such as a CD ROM or other optical media. Hard disk drive 1 70, 
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magnetic disk drive 1 80, and optical disk drive 1 9 1 are connected to the system bus 1 30 by a 
hard disk drive interface 192, a magnetic disk drive interface 193, and an optical disk drive 
interface 1 94, respectively. The drives and their associated computer-readable media provide 
nonvolatile storage of computer readable instructions, data structures, program modules and 
other data for personal computer 100. It will be appreciated by those skilled in the art that 
other types of computer readable media that can store data that is accessible by a computer, 
such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, 
random access memories (RAMs), read only memories (ROMs), and the like, may also be 
used in the example operating environment. 

A number of program modules can be stored on hard disk drive 170, magnetic disk 
190, optical disk 192, ROM 140 or RAM 150, including an operating system 195, one or 
more application programs 1 96, other program modules 1 97, and program data 1 98. A user 
can enter commands and information into computer 100 through input devices such as a 
keyboard 101 and pointing device 102. Other input devices (not shown) may include a 
microphone, joystick, game pad, satellite dish, scanner or the like. These and other input 
devices are often connected to processing unit 1 1 0 through a serial port interface 1 06 that is 
coupled to the system bus, but may be connected by other interfaces, such as a parallel port, 
game port or a universal serial bus (USB). Further still, these devices may be coupled 
directly to system bus 130 via an appropriate interface (not shown). A monitor 107 or other 
type of display device is also connected to system bus 130 via an interface, such as a video 

-7- 



MS 163148.2 

B&WRef No. 3797.00091 
Inventor: LuisHuapaya 

adapter 108. In addition to the monitor, personal computers typically include other 
peripheral output devices (not shown), such as speakers and printers. In a preferred 
embodiment, a pen digitizer 1 65 and accompanying pen or stylus 1 66 are provided in order 
to digitally capture freehand input. Although a direct connection between pen digitizer 165 
and processing unit 1 1 0 is shown, in practice, pen digitizer 1 65 may be coupled to processing 
unit 1 1 0 via a serial port, parallel port or other interface and system bus 1 30 as known in the 
art. Furthermore, although digitizer 1 65 is shown apart from monitor 1 07, it is preferred that 
the usable input area of digitizer 165 be co-extensive with the display area of monitor 107. 
Further still, digitizer 1 65 may be integrated in monitor 1 07, or may exist as a separate device 
overlaying or otherwise appended to monitor 1 07. 

Computer 100 can operate in a networked environment using logical connections to 
one or more remote computers, such as a remote computer 1 09. Remote computer 1 09 can 
be a server, a router, a network PC, a peer device or other common network node, and 
typically includes many or all of the elements described above relative to computer 100, 
although only a memory storage device 1 1 1 has been illustrated in Figure 1. The logical 
connections depicted in Figure 1 include a local area network (LAN) 1 12 and a wide area 
network (WAN) 113. Such networking environments are commonplace in offices, 
enterprise-wide computer networks, intranets and the Internet. 

When used in a LAN networking environment, computer 100 is connected to local 
network 1 1 2 through a network interface or adapter 1 14. When used in a WAN networking 
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environment, personal computer 100 typically includes a modem 115 or other device for 
establishing a communications over wide area network 113, such as the Internet. Modem 
1 15, which may be internal or external, is connected to system bus 130 via the serial port 
interface 1 06. In a networked environment, program modules depicted relative to personal 
computer 100, or portions thereof, may be stored in a remote memory storage device. 

It will be appreciated that the network connections shown are exemplary and other 
techniques for establishing a communications link between the computers can be used. The 
existence of any of various well-known protocols such as TCP/IP, Ethernet, FTP, HTTP and 
the like is presumed, and the system can be operated in a client-server configuration to permit 
a user to retrieve web pages from a web-based server. Any of various conventional web 
browsers can be used to display and manipulate data on web pages. 

Figure 2 illustrates a tablet PC 201 that can be used in accordance with various 
aspects of the present invention. Any or all of the features, subsystems, and functions in the 
system of Figure 1 can be included in the computer of Figure 2. Tablet PC 201 includes a 
large display surface 202, e.g., a digitizing flat panel display, preferably, a liquid crystal 
display (LCD) screen, on which a plurality of windows 203 is displayed. Using stylus 204, a 
user can select, highlight, and write on the digitizing display area. Examples of suitable 
digitizing display panels include electromagnetic pen digitizers, such as the Mutoh or 
Wacom pen digitizers. Other types of pen digitizers, e.g., optical digitizers, may also be 
used. Tablet PC 201 interprets marks made using stylus 204 in order to manipulate data, 
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enter text, and execute conventional computer application tasks such as spreadsheets, word 
processing programs, and the like. 

A stylus could be equipped with buttons or other features to augment its selection 
capabilities. In one embodiment, a stylus could be implemented as a "pencil" or "pen", in 
which one end constitutes a writing portion. The other end of the stylus constitutes an 
"eraser" end, which, when moved across the display, indicates portions of the display that are 
to be erased. Other types of input devices, such as a mouse, trackball, or the like could be 
used. Additionally, a user's own finger could be used for selecting or indicating portions of 
the displayed image on a touch-sensitive or proximity-sensitive display. Consequently, the 
term "user input device", as used herein, is intended to have a broad definition and 
encompasses many variations on well-known input devices. 

A primary aspect of the invention provides that information, i.e., text or commands, 
entered using a digitizing pen and a digitizing writing surface, i.e., pen strokes, is directed to 
the last window of a display or an application that was in a focus state. 

A related aspect of the invention determines whether an input field is context- 
sensitive information whether, that is, whether the input field accepts a generic text input or a 
more special input, such as an e-mail address input or a URL input. One aspect of the 
invention uses the context-sensitive nature of an input window for optimizing text 
recognition. It should be noted, though, that context-sensitive information, as used herein, 
encompasses windows that do not accept text, but have a context-sensitive behavior. For 
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example, controls (i.e., windows), such as Scrollbars and Buttons, have a behavior that 
differs from the behavior of a generic pen. Behavior modification does not limit itself to text 
recognition. Behavior modification, as used herein, also encompasses simulated mouse 
events (i.e. WMJLBUTTONDOWN and WMJLBUTTONUP). For example, the generic 
behavior for a "Press and Hold" event is to generate a 
WM JtBUTTONDO WN/WM JtBUTTONUP event pair. If, however, the "Press and Hold" 
event occurs on top of a control (i.e. windows) such as a Scrollbar or Button, this behavior is 
modified not to generate the right-button mouse events. 

According to the invention, text and/or commands can be entered through an input 
window that can be selected from a tray icon. Such an input window can include, for 
example, a softkey keyboard and/or one or more writing pads. Figures 3a-3c respectively 
show an exemplary softkey keyboard 300, an exemplary character pad 310 and an exemplary 
word pad 320. Particular keys displayed on softkey keyboard 300 can be selected in a well- 
known manner for entering text and commands in to an application. A user can write a 
single character within character pad 310 using a digitizing pen for entering a single 
character input into an application. Similarly, a user can write a word or phrase within word 
pad 320 using a digitizing pen for entering a word or phrase of words as an input into an 
application. 

To avoid a situation in which the focus given to a current application is lost when an 
input window, such as shown in Figures 3a-3c, is selected using a portion of the display 
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having system level properties, such as a tray icon, a software button, a gesture on a 
digitizing writing surface, or an in-air gesture. Another input technique that can have system 
properties includes a hardware button. The present invention keeps track of whether the last 
selected window or input was a system window, a system input field or a system hardware 
button. When the last focus is a window, input field or hardware button having system 
properties, the invention ignores the system window, input field or hardware button in favor 
of the previous last window having focus. 

To provide the advantages of the present invention, a hierarchy of window 
information is constructed so that each application (and each HWND for an application) has 
a unique and easily identifiable hierarchy. As used herein HWND is an acronym for a 
handle, or an identifier, for a particular open window. An HWND associated with a 
particular window contains operating system information that uniquely identifies the 
particular window and provides a set of properties possessed by the particular window. 
Consequently, because each HWND can be uniquely identified, information about each of 
HWND is stored in a hierarchy/class database that the present invention uses for determining 
whether a selected HWND is a system window or an application HWND and the context 
sensitivity of the particular HWND based on the properties possessed by the window. 
Preferably, each unique HWND is defined and assigned by the organization, such as a 
software supplier or creator, that is responsible for creating the corresponding window. 

Figure 4 shows a functional block diagram of the present invention. In Figure 4, a 
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computer operating system (OS) 401 creates and maintains real-time OS window information 
402 arranged, for example, as an interface window HWND hierarchy. For example, real- 
time window information 402 is arranged to have a root Desktop and a hierarchy of open 
windows located below the Desktop. The exemplary hierarchy shown in Figure 4 is arranged 
to be a three dimensional hierarchy having each open HWND designated by a vector 
HWND(x,y,z). Specifically, open windows HWND (1,0,0), HWND(2,0,0), 
HWND(3, 0, 0) and HWND(4, 0, 0) are shown directly below the Desktop root, and open 
windows HWND(1, 1, 0), HWND(1, 2, 0) and HWND(1, 3, 0) are shown directly below 
window HWND(1, 0, 0). Of course, it should be understood that each dimension can any 
number of elements. Moreover, although only three dimensions are indicated for 
convenience, it should also be understood that the hierarchical arrangement shown in 
Figure 4 could have any number of dimensions. 

As operating system 401 creates a window, a corresponding unique HWND is 
placed into real-time window information 402. Accordingly, when a window is closed, the 
corresponding unique HWND for the closed window is removed from real-time window 
information 402. In order to determine whether a window should properly be given keyboard 
focus, the present invention continuously keeps track of the window hierarchy (i.e., window 
relationships) associated with the operating system by creating a working database 403. That 
is, the present invention continuously "spies" on the message queue of operating system 401 
in a well-known manner in order to determine when a new window has been created and 



- 13- 



MS 163148.2 

B&WRef. No. 3797.00091 
Inventor: Luis Huapaya 

when an existing window has been closed. When a new window has been created, the 
present invention enters information relating to the new HWND into working database 403. 
The present invention then accesses a hierarchy/class database 404 to obtain additional 
information so that the informational context of a window can be determined. Accordingly, 
when a window is closed, the present invention deletes information relating to the closed 
HWND from working database 403. 

Hierarchy/class database 404 is a local database that contains information relating to 
the properties of all windows that can possibly be opened on the computer system in which 
operating system 401 is executing. That is, database 404 contains information relating to the 
properties for all windows that can possibly be opened and displayed whether the window is 
an operating system class window or an application class window. As mentioned, the 
operating system supplier preferably assigns a unique HWND and corresponding properties 
to each window that can possibly be opened by the operating system. When the operating 
system is loaded onto the computer, hierarchy/class database 404 is, for example, created as 
part of the operating system installation process. Similarly, for each application, the 
application supplier preferably assigns a unique HWND and corresponding properties to each 
window that can possibly be opened by the application. When the application is loaded onto 
the computer, the information relating to the windows that can be opened by the application 
is loaded into hierarchy/class database 404. 

The present invention also keeps track of the last valid "Non-tray, Non-desktop" 
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HWND 405 so that when queried, the last valid HWND can again be given focus. The 
information stored in working database 403 can also be used by components operating within 
a computer system, such as an application 406 or an input panel (not shown), for determining 
proper focus and context-sensitive information about a particular HWND at runtime. 

Preferably, the present invention records information in working database 403 
relating to a parent window HWND for a window that is currently in focus. The specific 
operating system window information that the present invention records for a parent window 
in working database 403 relates to a ClassName, a Style, and an ExStyle (extended Style). 
ClassName is a text string that identifies the class of a window in a well-known manner. 
Style is, for example, a 32-bit value providing s style mask in a well-known manner. ExStyle 
is, for example, a 32-bit value providing an extended style mask in a well-known manner. 
Additionally, the present invention stores the following unique information in working 
database 403 for each HWND, such as whether an HWND is a scrollbar; whether an HWND 
is a text input field (i.e., whether the HWND accepts text); whether an HWND is a generic 
input field; whether an HWND is a filename input field; whether an HWND is an e-mail 
input field; and whether an HWND is a URL input field; whether an HWND is a button; 
whether an HWND is a radio-button; whether an HWND is a checkbox; and whether an 
HWND is a slider. The present invention also determines whether an HWND accepts a press 
and hold event performed with a digitizing pen. 

The present invention includes a single COM interface 407 referred to herein as 
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ItellMe through which an application 406 can request information regarding a particular 
HWND that has been created through an API call user interface shell 408. The following 
pseudocode illustrates the ItellMe interface. 



DECLARE_INTERFACE_( ITellMe, IUnknown ) 
{ 

// IUnknown interfaces 



STDMETHOD (Querylnterface) (THIS_ REFIID, LPVOID *) PURE; 
STDMETHOD_(ULONG, AddRef) (THIS) PURE; 
STDMETHODJULONG, Release) (THIS) PURE; 



IApplicationEntry interface methods 



STDMETHOD (GetWindowCapabilities) (THIS_ const POINT *, LPWINDOWCAPS) 
PURE; 

STDMETHOD (GetLastValidFocusHWnd) (THIS_ HWND *) PURE; 

}; 

The GetWindowCapabilities function is used for determining special context 
sensitive information about a topmost HWND at a particular screen coordinate. The 
following function call illustrates the GetWindowsCapabilities function: 



STDMETHOD GetWindowCapabilities( 

const POINT * pScreenCoordinate, 
LPWINDOWCAPS pWindowCapabilities; 
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); 

The pScreenCoordinate parameter is a pointer to a POINT containing the coordinates 
of the HWND. The pWIndowCapabilities parameter is a pointer to a WINDOWCAPS 
structure that contains the context sensitive information of the topmost HWND found at the 
screen coordinate pScreenCoordinate. 

When the GetWindowsCapabilities method succeeds, the return value is S_OK. 
When the GetWindowsCapabilities method fails, a FAILEDO COM error code is returned. 

The WINDOWCAPS structure is: 

typedef struct 
{ 

DWORD dwSize; 

DWORD dwCapabilitiesMask; 

} WINDOWCAPS, *LPWINDOWCAPS; 

The parameter dwSize member of the WINDOWCAPS structure is initialized to 
sizeof(WINDOWCAPS) before calling GetWindowCapabilitiesO- The dwCapabilitiesMask 
can be one of the following: 

• TELLMECAPPRESSANDHOLDNOT ALLOWED 

• TELLMECAPTAKESTEXTINPUT 

• TELLME_CAP_EMAIL 

• TELLME_CAP_URL 

• TELLME_CAP_FILENAME 
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The GetLastValidFocusH Wnd method is used for determining which HWND that is 
not part of the desktop (i.e., ProgMan) and not part of the TaskBar (i.e,. SysTray) last 
received focus. The GetLastValidFocusHWnd method is used in order to give back focus to 
the last application that had focus before the user activated, for example, a user interface 
pane by using the tray icon (which causes focus to be lost). 

STDMETHOD GetLastValidFocusHWnd( 
HWND * phWindow 

); 

The phWindow parameter is a pointer to an HWND variable that will receive the 
HWND of the last non-system window that received focus. 

When the GetLastValidFocusHWnd method succeeds, the return value is S_OK. 
When the GetLastValidFocusHWnd method fails, a FAILEDO COM error code is returned. 

While the present invention has been described in connection with the illustrated 
embodiments, it will be appreciated and understood that modifications may be made without 
departing from the true spirit and scope of the invention. 



- 18- 



